Examples

Release Highlights

These examples illustrate the main features of the releases of scikit-learn.

Release Highlights for scikit-learn 0.23

Release Highlights for scikit-learn 0.24

Release Highlights for scikit-learn 0.22

Biclustering

Examples concerning the sklearn.cluster.bicluster module.

A demo of the Spectral Co-Clustering algorithm

A demo of the Spectral Biclustering algorithm

Biclustering documents with the Spectral Co-clustering algorithm

Calibration

Examples illustrating the calibration of predicted probabilities of classifiers.

Comparison of Calibration of Classifiers

Probability Calibration curves

Probability calibration of classifiers

Probability Calibration for 3-class classification

Classification

General examples about classification algorithms.

Recognizing hand-written digits

Normal, Ledoit-Wolf and OAS Linear Discriminant Analysis for classification

Plot classification probability

Classifier comparison

Linear and Quadratic Discriminant Analysis with covariance ellipsoid

Clustering

Examples concerning the sklearn.cluster module.

An example of K-Means++ initialization

Plot Hierarchical Clustering Dendrogram

Feature agglomeration

A demo of the mean-shift clustering algorithm

Demonstration of k-means assumptions

Online learning of a dictionary of parts of faces

Vector Quantization Example

Demo of affinity propagation clustering algorithm

Agglomerative clustering with and without structure

Various Agglomerative Clustering on a 2D embedding of digits

Segmenting the picture of greek coins in regions

K-means Clustering

Spectral clustering for image segmentation

A demo of structured Ward hierarchical clustering on an image of coins

Demo of DBSCAN clustering algorithm

Color Quantization using K-Means

Hierarchical clustering: structured vs unstructured ward

Agglomerative clustering with different metrics

Inductive Clustering

Demo of OPTICS clustering algorithm

Compare BIRCH and MiniBatchKMeans

Empirical evaluation of the impact of k-means initialization

Adjustment for chance in clustering performance evaluation

Comparison of the K-Means and MiniBatchKMeans clustering algorithms

Feature agglomeration vs. univariate selection

Comparing different hierarchical linkage methods on toy datasets

A demo of K-Means clustering on the handwritten digits data

Selecting the number of clusters with silhouette analysis on KMeans clustering

Comparing different clustering algorithms on toy datasets

Covariance estimation

Examples concerning the sklearn.covariance module.

Ledoit-Wolf vs OAS estimation

Sparse inverse covariance estimation

Shrinkage covariance estimation: LedoitWolf vs OAS and max-likelihood

Robust covariance estimation and Mahalanobis distances relevance

Robust vs Empirical covariance estimate

Cross decomposition

Examples concerning the sklearn.cross_decomposition module.

Principal Component Regression vs Partial Least Squares Regression

Compare cross decomposition methods

Dataset examples

Examples concerning the sklearn.datasets module.

The Digit Dataset

The Iris Dataset

Plot randomly generated classification dataset

Plot randomly generated multilabel dataset

Decision Trees

Examples concerning the sklearn.tree module.

Decision Tree Regression

Multi-output Decision Tree Regression

Plot the decision surface of a decision tree on the iris dataset

Post pruning decision trees with cost complexity pruning

Understanding the decision tree structure

Decomposition

Examples concerning the sklearn.decomposition module.

Beta-divergence loss functions

PCA example with Iris Data-set

Incremental PCA

Comparison of LDA and PCA 2D projection of Iris dataset

Factor Analysis (with rotation) to visualize patterns

Blind source separation using FastICA

Principal components analysis (PCA)

FastICA on 2D point clouds

Kernel PCA

Model selection with Probabilistic PCA and Factor Analysis (FA)

Sparse coding with a precomputed dictionary

Image denoising using dictionary learning

Faces dataset decompositions

Ensemble methods

Examples concerning the sklearn.ensemble module.

Pixel importances with a parallel forest of trees

Decision Tree Regression with AdaBoost

Plot individual and voting regression predictions

Feature importances with forests of trees

IsolationForest example

Monotonic Constraints

Plot the decision boundaries of a VotingClassifier

Comparing random forests and the multi-output meta estimator

Prediction Intervals for Gradient Boosting Regression

Gradient Boosting regularization

Plot class probabilities calculated by the VotingClassifier

Gradient Boosting regression

OOB Errors for Random Forests

Two-class AdaBoost

Hashing feature transformation using Totally Random Trees

Multi-class AdaBoosted Decision Trees

Discrete versus Real AdaBoost

Early stopping of Gradient Boosting

Feature transformations with ensembles of trees

Gradient Boosting Out-of-Bag estimates

Single estimator versus bagging: bias-variance decomposition

Categorical Feature Support in Gradient Boosting

Plot the decision surfaces of ensembles of trees on the iris dataset

Combine predictors using stacking

Examples based on real world datasets

Applications to real world problems with some medium sized datasets or interactive user interface.

Outlier detection on a real data set

Compressive sensing: tomography reconstruction with L1 prior (Lasso)

Topic extraction with Non-negative Matrix Factorization and Latent Dirichlet Allocation

Faces recognition example using eigenfaces and SVMs

Model Complexity Influence

Visualizing the stock market structure

Wikipedia principal eigenvector

Species distribution modeling

Libsvm GUI

Prediction Latency

Out-of-core classification of text documents

Feature Selection

Examples concerning the sklearn.feature_selection module.

Recursive feature elimination

Comparison of F-test and mutual information

Pipeline Anova SVM

Recursive feature elimination with cross-validation

Model-based and sequential feature selection

Test with permutations the significance of a classification score

Univariate Feature Selection

Gaussian Mixture Models

Examples concerning the sklearn.mixture module.

Density Estimation for a Gaussian mixture

Gaussian Mixture Model Ellipsoids

Gaussian Mixture Model Selection

GMM covariances

Gaussian Mixture Model Sine Curve

Concentration Prior Type Analysis of Variation Bayesian Gaussian Mixture

Gaussian Process for Machine Learning

Examples concerning the sklearn.gaussian_process module.

Illustration of Gaussian process classification (GPC) on the XOR dataset

Gaussian process classification (GPC) on iris dataset

Comparison of kernel ridge and Gaussian process regression

Illustration of prior and posterior Gaussian process for different kernels

Iso-probability lines for Gaussian Processes classification (GPC)

Probabilistic predictions with Gaussian process classification (GPC)

Gaussian process regression (GPR) with noise-level estimation

Gaussian Processes regression: basic introductory example

Gaussian process regression (GPR) on Mauna Loa CO2 data.

Gaussian processes on discrete data structures

Generalized Linear Models

Examples concerning the sklearn.linear_model module.

Lasso path using LARS

Plot Ridge coefficients as a function of the regularization

SGD: Maximum margin separating hyperplane

SGD: convex loss functions

Ordinary Least Squares and Ridge Regression Variance

Plot Ridge coefficients as a function of the L2 regularization

SGD: Penalties

Logistic function

Polynomial interpolation

Regularization path of L1- Logistic Regression

Logistic Regression 3-class Classifier

SGD: Weighted samples

Non-negative least squares

Linear Regression Example

Robust linear model estimation using RANSAC

Sparsity Example: Fitting only features 1 and 2

HuberRegressor vs Ridge on dataset with strong outliers

Lasso on dense and sparse data

Comparing various online solvers

Joint feature selection with multi-task Lasso

MNIST classification using multinomial logistic + L1

Plot multi-class SGD on the iris dataset

Orthogonal Matching Pursuit

Lasso and Elastic Net for Sparse Signals

Curve Fitting with Bayesian Ridge Regression

Theil-Sen Regression

Plot multinomial and One-vs-Rest Logistic Regression

Robust linear estimator fitting

L1 Penalty and Sparsity in Logistic Regression

Lasso and Elastic Net

Automatic Relevance Determination Regression (ARD)

Bayesian Ridge Regression

Lasso model selection: Cross-Validation / AIC / BIC

Multiclass sparse logistic regression on 20newgroups

Early stopping of Stochastic Gradient Descent

Poisson regression and non-normal loss

Tweedie regression on insurance claims

Inspection

Examples related to the sklearn.inspection module.

Permutation Importance with Multicollinear or Correlated Features

Permutation Importance vs Random Forest Feature Importance (MDI)

Partial Dependence and Individual Conditional Expectation Plots

Common pitfalls in interpretation of coefficients of linear models

Kernel Approximation

Examples concerning the sklearn.kernel_approximation module.

Scalable learning with polynomial kernel aproximation

Manifold learning

Examples concerning the sklearn.manifold module.

Swiss Roll reduction with LLE

Comparison of Manifold Learning methods

Multi-dimensional scaling

t-SNE: The effect of various perplexity values on the shape

Manifold Learning methods on a severed sphere

Manifold learning on handwritten digits: Locally Linear Embedding, Isomap…

Miscellaneous

Miscellaneous and introductory examples for scikit-learn.

Compact estimator representations

ROC Curve with Visualization API

Visualizations with Display Objects

Isotonic Regression

Advanced Plotting With Partial Dependence

Face completion with a multi-output estimators

Multilabel classification

Comparing anomaly detection algorithms for outlier detection on toy datasets

The Johnson-Lindenstrauss bound for embedding with random projections

Comparison of kernel ridge regression and SVR

Explicit feature map approximation for RBF kernels

Missing Value Imputation

Examples concerning the sklearn.impute module.

Imputing missing values with variants of IterativeImputer

Imputing missing values before building an estimator

Model Selection

Examples related to the sklearn.model_selection module.

Plotting Cross-Validated Predictions

Confusion matrix

Plotting Validation Curves

Detection error tradeoff (DET) curve

Successive Halving Iterations

Underfitting vs. Overfitting

Parameter estimation using grid search with cross-validation

Comparing randomized search and grid search for hyperparameter estimation

Train error vs Test error

Receiver Operating Characteristic (ROC) with cross validation

Nested versus non-nested cross-validation

Demonstration of multi-metric evaluation on cross_val_score and GridSearchCV

Sample pipeline for text feature extraction and evaluation

Balance model complexity and cross-validated score

Comparison between grid search and successive halving

Visualizing cross-validation behavior in scikit-learn

Receiver Operating Characteristic (ROC)

Precision-Recall

Plotting Learning Curves

Statistical comparison of models using grid search

Multioutput methods

Examples concerning the sklearn.multioutput module.

Classifier Chain

Nearest Neighbors

Examples concerning the sklearn.neighbors module.

Nearest Neighbors regression

Outlier detection with Local Outlier Factor (LOF)

Nearest Centroid Classification

Kernel Density Estimation

Nearest Neighbors Classification

Caching nearest neighbors

Neighborhood Components Analysis Illustration

Novelty detection with Local Outlier Factor (LOF)

Comparing Nearest Neighbors with and without Neighborhood Components Analysis

Dimensionality Reduction with Neighborhood Components Analysis

Kernel Density Estimate of Species Distributions

Simple 1D Kernel Density Estimation

Approximate nearest neighbors in TSNE

Neural Networks

Examples concerning the sklearn.neural_network module.

Visualization of MLP weights on MNIST

Restricted Boltzmann Machine features for digit classification

Compare Stochastic learning strategies for MLPClassifier

Varying regularization in Multi-layer Perceptron

Pipelines and composite estimators

Examples of how to compose transformers and pipelines from other estimators. See the User Guide.

Concatenating multiple feature extraction methods

Pipelining: chaining a PCA and a logistic regression

Selecting dimensionality reduction with Pipeline and GridSearchCV

Column Transformer with Mixed Types

Column Transformer with Heterogeneous Data Sources

Effect of transforming the targets in regression model

Preprocessing

Examples concerning the sklearn.preprocessing module.

Using KBinsDiscretizer to discretize continuous features

Demonstrating the different strategies of KBinsDiscretizer

Importance of Feature Scaling

Map data to a normal distribution

Feature discretization

Compare the effect of different scalers on data with outliers

Semi Supervised Classification

Examples concerning the sklearn.semi_supervised module.

Label Propagation learning a complex structure

Label Propagation digits: Demonstrating performance

Decision boundary of semi-supervised classifiers versus SVM on the Iris dataset

Effect of varying threshold for self-training

Semi-supervised Classification on a Text Dataset

Label Propagation digits active learning

Support Vector Machines

Examples concerning the sklearn.svm module.

Non-linear SVM

SVM: Maximum margin separating hyperplane

SVM with custom kernel

SVM Tie Breaking Example

SVM: Weighted samples

Plot the support vectors in LinearSVC

SVM: Separating hyperplane for unbalanced classes

SVM-Kernels

SVM-Anova: SVM with univariate feature selection

Support Vector Regression (SVR) using linear and non-linear kernels

SVM Margins Example

One-class SVM with non-linear kernel (RBF)

Plot different SVM classifiers in the iris dataset

Scaling the regularization parameter for SVCs

RBF SVM parameters

Tutorial exercises

Exercises for the tutorials

Digits Classification Exercise

Cross-validation on Digits Dataset Exercise

SVM Exercise

Cross-validation on diabetes Dataset Exercise

Working with text documents

Examples concerning the sklearn.feature_extraction.text module.

FeatureHasher and DictVectorizer Comparison

Clustering text documents using k-means

Classification of text documents using sparse features